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ABSTRACT 


The Wllliaras-type yield model is based on multiple regression analysis of 
historical time series data at CRD level pooled to regional level (graips of 
similar CRD's). Basic variables considered in the analysis include USDA yi^d, 
monthly mean temperature, ireonthLy frecipitatlon, soil texture and topographic 
information, and variables derived from these. Technological .trend is r^re- 
sented by piecevdse linear and/or quadratic finctions of year. Indicators of 
yield reliability obtained frcm a ten-year bootstrap test (1970-1979) 
demonstrate tb •> biases are small and performance based on root nean square 
error spears xo be acceptable for the intended AgRISTARS large area 
applications. The nodel is objective, adequate, timely, simple, and not costly. 
It considers scientific kiowied^ on a broad scale but not in detail, and does 
not provide a good current neasure of modeled yield reliability. 
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Evaluation of WHliams-Type Moc3el 
for Barley Yid.ds in 
North Daioota and Minnesota 

Sunmary 

The Williams-type yield model is based on multiple regression analysis 
of historical time series data at CRD level pooled tc regional level 
(groups of staiilar CRD's). Basio variables considered in the analysis 
include USDA yield, monthly mean tanperature, monthly precipitation, soil 
texture and topographic information, and variables derived from these. 
Technological trend is represented by piecevdse linear and/or quadratio 
functions of year. Model performance is evaluated on the basis of ejight 
criteria, reliability, objectivity, consistency vdth scientific kiowled^, 
adequacy, timeliness, cost, simplicity, and accurate current measures of 
modeled yield reliability. Ten year bootstrap tests (1970-1979) were run 
for each crop reporting district In the mjor barley producing r^ions of 
North Dakota and Minnesota. Indicators of yield reliability obtained frcm 
a ten-year bootstrap test (1970-1979) demonstrate that biases are srrall and 
performance based on root nBan square error is generally acceptable for the 
int aided AgRISTARS large area applications. The model is objective, 
adequate, timely, simple, and not costly. It considers scientific 
knowledge on a broad scale tut not In detail, and does not provide a good 
current measure of modeled yield reliability. 

Description of Model 

A model for analyzing the effects of vieather and soil variable on 
Canadian barley yields was described by V/illians et. al. (G.D.V. Williams, 
M.I. Joynt, P.A. McCormick, Regression Analysis of Canadian Prairie Crcp 
District Cereal Yields, 1961-1972, in Relation to Weather, Soil, and 


Trend, Can, J. Soil Sci, 55, 43-53, PebnAary 1975) • The irodels for 

Canadian wehat, barley and rye pooled crop district vjeather and agrononic 
« 

data bo ^larger soil-color regions and incorporated soil texture and 
topographic Information along with trend and weather, 

A predictive yield model for barley In North Dalrata (ND) and Minnesota 
(MN), based on the concepts outlined by wil.liams et. al., was 
developed and tested by the AgPISTARS Yi^d Model Development Group, The 
model incorporated CRD-level weather (monthly mean tenperature and total 
precipitation), soil texture, and topography in a manner as similar as 
possible to that used by Williams. The CRD-level data were pooled to the 
following two more-or-less environmentally homogeneous regions; 

(a) Red River Valley (MNRR) - consisting of ND CRD’s 30 and 60 and MN 
CRD’s 10 and 40j 

(b) The remainder of North Dakota (NIHEM) - consisting of ND CRD’s 
10,20,40,50,70,80,90. 

S^arate models were developed for the two regions to provide predic- 
tions of CRD yie3.ds using individual CRD weather/soil data with coef- 
ficients fran the pooled model. IVbdels vere also developed for the two 
states, ND and MN, based on state-aggcegated weather/soil data. 

Models were developed on the basis of data fraiji 1932 through 1979* 

The terms were selected fron st^wise r^resslons from which the most sl@ii- 
f leant ten (or fewer) terms wre retained for each region. A limit of 10 
terms had been used by Williams et, al. and seemed to be a reasonable upper 
limit in applying this method. The basic weather/soll/ trend inputs are: 
monthly mean temperature; 
total monthly precipitation; 

percent of soils in the CRD in textural 
classes— coarse, medium and fine; 
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percent of CRD area In the topographic class 
level to gently uridulatingi 

year as surrogate for technological etc. trend j 

These basic iiiputs are used to calculate the possible irodel variables 

Trend 1 (=1 for 1931,..., 31 for 1961 j 32 for 1962 and beyond); 

* 

Trend 2 (=0.1 for 1931-1961, 1 for 1962,..., 17 for 1979); 

Trend 2 squared; 

Tx = .75(^ fine soil) + ,65i% medium soil) + .35(^ coarse soil); 

Tx squared; 

Top - % of area level to gently mdulatlng; 

Top squared; 

C = precipitation September- Apr 11; 

C squared; 

E5, b 6, E7 = potential evapotranspiratlon caluclulated by the 
Thomthwaite method (Thomthwaite, C.W.j '*An 
Approach Toward a Rational Classification of Climate," 
Geog. Rev . 38: 55-94, 1948) for May, June, July; 

E5, B6, E7 squared; 

D6, D7^* = moisture deficits = E - precipitation for June, July; 

D5, D6, D7 squared; 

Do - seasonal cteflcit = D5 + D6 + D7 - C; 

Do squared; 

Tx X Do 

*Trend was chosen bo correspond to the CEAS barley yield moctel ''Motha, 

R.P., Barley Models for North Dakota and Minnesota", NOAA-CEAS, Coluirbia, 
MO, May 198O) to permit more direct comparison. Model fits using TREND2 = 
1.0 made no sigiif leant differences in yield model predictions. 

**D5 was not used since D5, D6, D7, C and Do are not all mutually 
Independent . 

Of these possible terms, the stepwise r^resslon selected 10 terms or fewer 
for each region. 
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Boot{?trap tests wsre conduoted to provide ten years of Independent 
tests of each nodel's predictive performance in a tianner .simulating very 
closely the way the nodols at'e applied in practice. Appendix 2 shov/s the 
terms Included In each nodel and the range of coefficients over ten dif- 
ferent but overlapping model base periods associated vdth the ten test 
years. There are some ^neral patterns, but a wide diversity In detail, 
reflecting both real region-to-region variations and vagaries of the 
regression process on noisy data. 

Only end-of-season models vere tested, althou^ "truncated" moctels 
providing yield estimates at the end of each nonth throughout the growing 
season wer^ possible. It was felt that rrEanlngful evaluation was difficult 
enough vhen the full-season weather was available. 

EVALUATION ^ETHODOLOGY 
Slight Model Characteristics to be Discussed 

The document. Crop Yield Model Test and Evaluation Criteria, (Wilson, 

et, al., 1980), states: 

"The model characteristics to be anphasized 
in the evaluation process are: yield indication 
reliability, objectivity, consistency with sci- 
entific knowledge, adequacy, timeliness, minimum 
costs, simplicity, and accurate current measures 
of modeled yield reliability." 

Each of these characteristics will be disucussed with respect to the 
Williams-type model. 

Bootstrap Technique Used to Generate 
Indicators of Yield Reliability 

Indicators of yield reliability (reviev'ed below) require that the 
parameters of the regression model be computed for a set of data and that a 
yield prediction be made based on that data for a given "test" year. The 
values required to ^nerate Indicators of yield reliability include the 

A 

predicted yield, Y, the actual (reported) yield, Y, and the difference bet- 


veen them, d » Y - Y, ibr each test year. It is desirable that the data 
used to generate the parameters for the model not Include data frcm the 
test year. 

In order to accomplish this, the "bootstrap" technique is used. 5br 
each test year, the years from aa earlier base period are used to fit the 
iTDdel and obtain a prediction equation. Ihe values of the Independent 
variables for the test year are inserted Into the equation and a oredicted 
yield is ^neratod. Then, the base period is shifted one year forward and 
the process is repeated. Continuing in this way, ten (1970-79) predictions 
of yield are obtained, each independent of the data used to fit the model. 

A 

The Y and d values for the ten year test period are obtained from 
models derived at the crop reporting district (CRD) level and state level, 
the latter based on a v^l^^ted average of CRD veather to state level. A 

A 

second set of Y values are obtained at state level using a weighted 
average of jredlcted yields fran the C® nodels, and at regional level 
using wei^ted averages of predicted yields from CRD and state models. In 
each case the weighting factors are harvested acreage for the prediction 
year. 

For the Red River Valley r^ion (MN CRD's 10 and 40, ND CRD's 30 and 
60) data from 1932-1969 are used to fit predictive models for 1970 data, 
from 1932-1970 are used to fit predictive models for 1971, etc. throu^i 
1979- 5hr the ronalnder of North Dakota (ND CRD's 10,20,40,50,70,80 & 90) 
data from 1948-1969 are used to fit predictive models for 1971, etc. 
through 1979* Ihe number of observations used for the two pooled moctels 
were rou^y equivalent; fewer years were used with the ranalnder of North 
Datota but more CRD's vere involved. This testing procedure closely simu- 
lates the way the models would be ^plied in practice. Results are listed 
in Appendix 1. 


The average and percent production as well as the average yield over 
the ten year test period are listed in Table 1 for each geographical 
region, and percent production is displayed in Figure 1, 

Review of Indicators of Yield Reliability 

A 

The Y, Y and d values for the ten-year test period at each geographic 
area my be suramarized into "various indicators of yield reliability. 

Indicators !^ed on d Demonstrate 
Accuracy. Precislcgi fnd Bias 

From the d value, the mean square error (root and relative root mean 
square error), the variance (standard deviation and relative standard 
deviation), and the bias (its square and the relative bias) are obtained. 

The root mean square error (RMSE) and the standard deviation (SD) 
Indicate the accuracy and precision of the nodel and are expressed in the 
original units of measure (quintals/hectare) . It is about 68 percent pi’o- 
bable that the absolute value of d for a future year will be less than one 
RMSE and 95 percent probable that it will be less than twice the RMSE. So, 
accurate prediction capability is Indicated by a small RMSE. 

A non- zero bias mans the no del is, on the average, overestimating the 
yield (positive bias) or underestimating the yield (negative bias). Ihe SD 
is smaller than the RMSE vhen there is non-zero bias and indicates vhat the 
RMSE would be if there vere no bias. If the bias is near zero, the SD and 
the RM.SF will be close in value. An unbiased model, i.e. bias close to 
zero, is preferred. 

Indicators Baaed on rd Demonstrate 
Worst and Best Perfonnance 

The relative difference, rd (lOOd/Y), is an especially useful indica- 
tor in years viiere a low actual yield is not predicted accurately. This is 
because years with small observed actual yields and large differences often 
have the largest rd values. 
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Several Indicators are cterived using relative differences. In order 
to calculate the proportion of years beyond a critical error limit, we 
count the number of years In vhich the absolute value of the r^ative dif- 
ference exceeds the critical limit of 10 percent. Values between 5 and 25 
percent were investigated and a critical limit of 10 percent vas found nost 
useful in describing nodel performance. The worst and next to worst per- 
formance during the test period are defined as the largest and next to 
largest absolute value of the r^ative difference. Ihe range of yi^d 
indication accuracy is defined by the largest and smallest absolute values 
of the relative difference. 

/\ 

Indicator Based on Y and Y Demonstrate 
Correspondence Betweoi Actual and Predicted Yields 

Another set of Indicators demonstrates the correspondence between 
actual and predicted yields, it would be desirable for increases in actual 
yield to be accompanied by Increases in predicted yields. It would also be 
desirable for large (small) actual yields to correspond to large (small) 
predicted yields. 

Two Indicators relate the change in direction of actual yields to the 
corresponding change in predicted yields. One looks at change fron the 
previous year (nine observations) and the other at change from the average 
of the previous three years (seven observations). A base period of three 
years is used since a longer base period would further decrease the nuntier 
of observations, vhlle a shorter period would not be very different frcra 
the conparison to a single previous year. 

Finally, the Pearson correlation coefficient, r, between the set of 
actual and predicted values for the test years is computed. Ihis repre- 
sents a measure of how veil deviations in the set of predicted yields 
correlate to deviations iSx the set of actual yields. It is desirable that 
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r(~l£ r £+ 1) be large and positive. A negative value Indicates smaller 
predicted yields occurring vdth larger observed yields (and vice versa). 

Current Measure of Modeled Yield Reliability 
Defined by a Correlation Coefficient 

One of the nodel characteristics to be evaluated is its ability to 
provide an accurate, current measure of modeled yield reliability. 

Although a specific statistic was not discussed in the paper, Crq) Yield 
Model Test and Evaluation Criteria, (Wilson, et. al., 1980), it was stated 
that; 

"This 'reliability of the reliability' characteristic 
can be evaluated by comparing nodel generated reliabllty 
measures with subsequently detennine deviation between 
modeled and 'true' yield." 

For regression models, this suggests the use of a correlation coef- 
ficient betwsei two variables generated for each t^t j^ar. Gie variable 
is an Indicator of a precision with viiich a prediction for the next year 
can be made, based on the model development base period and prediction year 
independdant variable values. The other variable (obtained retro- 
spectively) is an indicator of how close the predicted value for the next 
year actually is to the "true" value. The estimate of the standard error 
of a predicted value fron the base period model as applied In the predic- 
tion year is used for the first value, Sy, and the absolute value of the 
difference betweoi the predicted and actual yield in the test year is used 
as the second variable, | d | . Since Sy Incorporates current-year weather 
as compared to long-tem average, if the relations of yield to trend and 
weather specified in the model are valid the magiitude of Sy should fluc- 
tuate in phase with ! d I . 

A non-parametric (Spearman) corr^atlon coefficient, r, is anployed 
since the assun 5 >tlon of bivariate normality cannot be made. A positive 
value of r(-l 1 r 1. +1) indicates agreement between Sy and 1 d I , i.e., 
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smaller (larger) value of Sy is as soda, ted vd-th a smaller (larger) value of 
I d I . An r value close to +1 is desirable since it indicates that a small 
standard error of prediction (and therefore a narrow confidence interval 
about the true predicted value) is associated with small discrepancies bet- 
ween predicted. and actual yidds.. If this vere the case, one would have 
confidence, in using Sy as an indicator of the accuracy of Y. 

MODEL EyALUATION 

Plots of actual and predicted yields for MN and ND state level models 
are presented in Figures 2 and 3. Results of the ten-year bootstrap tests 
on vhich these evaluations v^re based are presented in Appendix 

Indicators of yield Reliability Based on d Show Moderate Bias, 
Standard Deviations Ranging from 1.8 to 2.9 Q/Ha . 
and RMSE Ranging lifom 2.3 to 4.2 Q/Ha 

A 

The Indicators of yield reliability based on deviations d (d = Y - Y) 
at CRD, state, and r^ion levels are given in Table 2. Root mean squared 
errors are presented in Figure 4. 

CRD level biases for ND range from -3.3 to +1.1 Q/Ha, with all but one 
value negative. The biases for the MJ] CRD's are -0.9 and -3.1 Q/Ha. The 
Williams-type model seans to be biased overall at CRD level by about -1 .4 
Q/Ha. 

Root Mean Square Errors (RMSE) for ND CRD’s range from 2.3 to 4.4 Q/Ha 
and for MN from 3.1 to 4.2 Q/Ha. State level RMSE values were on the order 
of 3.0 Q/Ha overall. 

Standard Deviation values ranged from 1.8 to 2.9 Q/Ha for ND CID’s 
with 2.9 Q^a for both MN CRD’s. State and r^ional values ranged frcm 2.1 
to 2.4 Q/Ha. 

Examination of plots of observed and predicted yields at state level 
in Figures 1 and 3 indicates that In both ND and MN the Williams-type model 
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prediction soon to te biased by a consistoit negative 2 Q/Ha in the years 
1975-1979 • ‘Ihis nay indicate a weakness in the Williams-type model and is 
discussed in the CX)NCLUSIOMS section. 

Indicators of Yield Reliability Based on rd Show 
that a Large Number of Cases have 50 Percent 
or More of Test Years with ! rd I 
* ■ Greater than 10 Percent 

The CRD, state and r^ion values for the indicators of yield reLi abi- 
lity based on rriative difference I rd f are given in Table 3 and Figures 5, 
6, and 7» 

E,l^t of the nine ND CED's and one of the two MN CRD’s show 50 percent 
or more of the test years withl rd I greater than 10 percent. State and 
regional results show all six cases with jO percent or more of the test 
years t rd ) greater than 10 percent. These results would seon to Indicate 
either a large natural variability in barley yields or a low level of model 
skills. Both are supported by the plots in Figures 2 and 3. If the model 
capabilities could be significantly Improved in the years 1975-1979 the 
indicators of yield reliability would also be much improved. 

For ND 1974 was the year with the largest relative difference in five 
of nijie CRD’s. In three CRD's 1973 was largest, and in one 1976 showed the 
largest difference. All 1974 cases r^resented an inability of the model 
to respond to a very low actual yield \ihile the 1973 and 1976 cases repre- 
sented inability to respond to a high actual yield. For MN 1976 and 1977 
were the worst years for model performance. 

A 

Indicators of Yield Reliability Based on Y and Y 
Show Ifederately Good Correspondence 
Between the Direction of Change in Predicted 
Yield Compaired to Actual Yield 

The p?edicted and actual yields at the state level are plotted in 
Figures 2 & 3- Ihe predicted yields, actual yields, and differences for 
CRD level are listed in Appendix 1. The CRD, state, and region level 
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values for Indicators of yield reliability based on actual and predicted 
yields are given Table 4 and Figures 8, 9 and 10. 

Seven of the nine ND and both CRD's show a change of direction of 
predicted yields fron the previous year corresponding to the actual change 
of direction nore than 50^ of the time. For state and regional models the 
response direction from the previous year is correct more than 50 ^ of the 
time in two of six cases, and from the three year average in all six cases. 
These results indicate that the Williams- type model does moderat^y well in 
responding to changes of actual yield, particularly changes fron a three- 
year base period. 

Resul.ts for the correlation coefficient, r, between predicted and 
actual yields, representing correlation between fluctuations of predicted 
and actual yields fron test period averages, appear fairly good. Of the 
eleven CRD’s six show r greater than 0.55 (the level required for 
one-tailed statistical significance). The score for state and regional 
models is all six greater than 0.55* While the directional response capa- 
bilities of the model show some r^iability, it should be kept in mind that 
r measures primarily correctness in direction of response. While response 
direction seans to be g^od, a glance at Figures 2 and 3, and at RMSE levels 
in Table 2, indicates that the Williams-type model leaves much to be 
desired in the correctness of magiitude In the responses. 

Base Period Indicates Itore Precision Than 
Independent Tests Can Confirm 

Certain statistics ^nerated fron the regression analysis of the base 
period data are often used to provide some indication of expected yield 
reliability. Howe'/er, these statistics only reflect how well the model 
describes the data used to generate the model, i.e., fit of the model, 
rather than how well the model can predict given new data. Therefore, it 
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is important to compare these indicators of fit of the no del to the inde- 
pendent indicators of yield reliability discussed in the preceding 
sections. In this way, one can see how these base period indicators of fit 
of the nodel do or do not correspond to independent test indicators of 
yield reliability. 

One indicator of yi^d reliability, the mean square error (MSE) , is 

A 

the sum of squared d values (d = Y - Y) for the independent test years 
divided by the number of test years (Table 2). The direct analogue for 
the model development base period is the residual mean square. The resi- 
dual mean square is obtained by first generating the usual least squares 
prediction equation using the base period years. The residual nean square 
is the sum of squared d values for these base period years divided by the 
appropriate degrees of freedom (number of l^se period years minus nurrfcer of 
parameters estimated in fitting the model). VIhereas one value of MSE is 
generated for each geographic area over the entire test period, a value of 
the residual mean square is ^nerated for each period corresponding to an 
Individual test year. 

High, low, and average values of residual mean square for CRD and 
state models are given in Table 5j along with the mean square error over 
the test years for each. The MSE over the independent test years ranges 
from 2.0 to 8.7 times the corresponding average residual mean square error. 

Another Indicator of yield r^iability is the correlation coefficient, 
r, between the observed and predicted yields for the Independent test years 
(Table 4). It is desirable for r to be close to +1, even thou^ it can be 
negative. The analogue for the model development base period is the square 
root of r 2, the coefficient of multiple detenninatlon. The square root of 
r 2, R (0 1 R 1 1), may be Interpreted as the correlation between obseirved 
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and predicted values for the base period years. Ihe low, high, and average 
values of R for each geographic area are given in Table 6, along with the 
Pearson correlation coefficient values from Table 4. 

Average correlation coefficients over the base period (model develop- 
ment years) range fran .93 to .97, indicating the moctel is doing a very 
good job of fitting the development data. The correlation coefficients 
over the Independent test years range fran a low of .47 and to a high of 
.85. The r value over the independent test years is generally only about 
two-thirds the average R for the model development years. Clearly the 
Williams type model does not respond as v^ll in a predictive mode as in a 
fitting mode. The values of R for model development years do not provide 
an effective indication of the predictive abilities of the model. 

Model is Reasonably Objective 

The Williams-type model is redeveloped (i.e., values of coefficients 
are re-derived) for each test year, based on available years prior to it. 
Once the proper terms have been selected and fixed, development and appli- 
cation of the model is quite objective. Some subjectivity is required for 
initially selecting the "most slgiificant" terms, in specifying trend, par- 
ticularly break points, in specifying textural and topographic data, and in 
choice of development years. 

Model Consider w Known Scientific 
Relationships on a Broad Scale 

• 

Large-area crop yields are known to be related to veather over the 
growing season, to pre-season stored soil moisture, and to a variety of 
other weather and agronomic factors. The details of the mathanatlcal rela- 
tionships that describe these physical and biological relationships are far 
from established. Even the proper set of variables is open to question 
because there are only a few readily available observables and the 
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variables formed from these tend to be highly Interr^ated. Large-area 
relationships are further confused by geographical variations ijc the obser- 
vables that may or may not be Important for any given situation. 

In li^t of these problems a practical ^proach was used consisting of 
statistical regression of observed yields to variables based on monthly 
weather data pooled to regional level.' Technological Impacts ytere repre- 
sented as a function of historical years (trend), and a policy of refittlrg 
for each predictive year based on all available prior years was followed. 
Thus the Wlllams-type model is susceptible to criticism in regard to 
agreement with scientific knowledge in many respects. A few of the more 
important are noted below. 

Selection of model terms is by stepwise regression. This guarantees 
only set of terms '’best" by some statistical criterion. Fhyslcal or 
biological slgilficance is not ensiired. It seems unlikely that the wide 
variety of "slgiif leant" terms represented In Appendix 2 for different 
models has a great deal of physical meaning. Of particular note are the 
textural and topographic terms found by Williams to be very Important in 
his large Canadian regions, die wi^uld expect these terms to show up in the 
NIKEM region (ND OFD's 10,20,40,50, 70,80,90) since these is a g?eat deal 
of variation over these regions, viiereas the MNFIR region (MN CFD's 10,40, 

ND CRD's 30,60) is quite homogeneous. Apptndix 2 shows that TX and TCP 
appear only in the MNRR model and TXDS appears in only the ND state mocfel. 
The terms appear to be functioning mainly as artificial variables that h^- 
poi in one case to be more significant than another. Little or no physical 
significance can be attached to them. Tie selection criteria in general 
have not been documented. 


Trends in technology and cropping practices are handled in the Williams- 
type nodel by representing them as piecewise linear and/or quadratic fmc- 
tlcns of time, Ihis ^osjies over the toiovn qualitative relationship of 
yield to variety irjprovcment, fertilizer use, etc., but r^resents a prac- 
tical way of treating the situation viiere it is unclear which effects are 
most impoi»tarit and where Infonnatlon' is limited,, Jbllowing Williams’ origi- 
nal approach, single trends were specified for the pooled sets, clearly an 
overslmplif ication. An assunptlon of poling is that the inherent fer- 
tility of the poled areas is the same (comnon intercept) for equivalent 
weather and soil types, inclusion of textural and topgraphic variables, 
parameters toiown to have a real effect, were intended to modify trend in 
different prts of the region. However, in view of the way they actually 
entered the models, they did not fmctlon in this iranner. 

The Williams type model takes no explicit account nf psts, disease, 
or other episodic events. 

Model is Adequate Only for the Region 
in Which It Was Developed 

By its nature the WHliaras-typ model can be applied ^-dth any degree 
of reliability only in the r^ion for viiich it was developed. The model is 
probably not extendable even to apprently similar regions. Ihe model can, 
however, be readily applied to any region for vhich a reasonable lengthy- 
record of yield, soil and weather observations exist. 

The Williams-type rtodel may have an advantage over regression-typ 
models developed at the smallest available regions (here CHD’s) in the case 
of short data records. Pooling provides a larger data set for the <feter- 
minatlon of significant terms and coefficients vhlle stHl giving yield 
predictions at the small region level. 
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Model is Timely Ehough for 
Intended Applications 

A yield nodel for a new year can be built as soon as the reliable 
yield and weather variable figures fron the past year are available, in the 
U.S, generally a few months after harvest. Yield predictions during an 
application year can be made shortly after the end of each month. 

Model is Not Costl y 

Data to develop and run the WUliams-"type model are readily available 
at low cost« Ihe multiple regressions needed to compute the meteorological 
and agrononic variables and develop models can be run on any modest sizse 
computer. Boutines are available in most computer libraries. 

Model is Simple 

The development and application of the Williams-type mtdel are 
straightforward. The only points vhere judgment is required are in selec- 
tion of slgiif leant terms and specification of trend, selection of soils 
variably, and specifying the capacity of the soil moisture bud^t. 

Model Has Poor Current Measure of 
Modeled Yield Reliability 

The CRD, state, and r^ion values of the correlation coefficient bet- 
ween the estimate of the standard error of the predicts yi^d values and 
the aboslute differences between predicted and actual yield are presented 
in Table 7 and Figure 11. The results are very poor. Ih eight of thir'feeen 
cases the correlation Is negative. State mo(tels show negative r. It is 
clear from the Spearman correlation coefficient that the base period pre- 
dicted accuracy and actual test year accuracy are not In close agreanent 
and thus the model does not give a useful current neasure of modeled yidLd 
reliability. 


Of 
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The WUliam8-type nodel representa an approach Involving pooling of 
CRD level data to derive a trodel for CFSD's vdthin that region. This provi- 
des a gDod deal mere data for a regression at the regional level but nay 
gloss over any CRD to CRD differences. There?ore the approach is a compro- 
mise in principle and its validity in practice can only be evaluated by 
testing. The data bases consist of observed yields, soil characteristics, 
and rronthly mean temerature and total precipitation. Indicators of yield 
reliability obtained from bootstrap testing are used as a basis for eva- 
luating nodel performance. Over the set of ten test years the noctel is 
reasonably reliable on-average. Biases are not large but seem to be 
slightly on the negative side. Root mean square errors over the ten test 
years are in the range of 3 Q/Ha, somewhat larger than one would prefer but 
appear reasonable for the Intended AgRISTARS large area applications. 

The Williams-type model does not consistently predict high and low yi^ds 
very reliably, and for any given year the actual error nay be ^p?eciably 
larger than the RMSE value across the 10 years. The model does not give a 
good current iiEasure of yield reliability. However, it is objective, ade- 
quate for Intended purposes, timely, simple, not costly, and makes a 
practical attempt at incorporating scientific kiowled^. 

Many general areas of needed Improvement could be cited. The most 
obvious specific area is to determine Why the Williams-type model seans to 
be consistently biased low in ND and/or from 1975 thru 1979. Elimi.natlon 
of this p:*oblem would appreciably improve RMSE and probably other indica- 
tors as well. A fit made with the TREND2S3 term removed, leaving linear 
trend segments 1931-1961 and 1962-1979^ gave predicted yields coinciding 
almost exactly with actual yields in 1975-1979 but with much poorer perfor- 
mance in 1970 - 1974 . Across the ten year test period the RMSE for this 
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alternative irodel fit was alightOLy worse than that for the original 
Williams-type model. Clearly, the fix is not sixjh a simple adjustment. 

Another area that should be investigated is why the textural and 
topographic variables enter in one case and not another, "niere is, for 
this reason, some question as to vhat these two variables really contribute. 
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’AVERAGE PROOU^flONf AND YIELD * 
FOR TEST YEARS 1970-79 


* * » ^ 


NORTH OAKOTA^kNO MINNESOTA 


STATE 

CRD 

PRODUCTION 

QUINTALS 

(1,000) 

BUSHELS 

PERCENT OF 
STATE REGION 

QNTL/HA^b 

D 

U/ACRE 

N. DAKOTA 

10 

1 »O0I 

4,964 

5.7 

3,9 

19.4 

36.1 


20 

i»964 

9,023 

10,3 



35,2 


30 

6,559 

30,126 

34,3 

24,0 

21.9 

40.8 


40 

473 

2,171 

2,5 

1.7 

19.4 

36,1 


50 

1,374 

6,309 

7.2 

5.0 

18,8 

34.9 


60 

4,700 

. 21,588 

24.6 

lZ-2 

23.3 

ft3*2 


70 

647 

2,972 

3.4 

2.4. 

18.9 

35.1 


80 

423 

1,943 

2.2 

1.5 

16,0 

29.7 


90 

1,885 

8,659 

9,9 

6.9 

20,0 

37,2 

STATE 


19,106 

87,754 


69,8 

21.0 

39.1 

MINNESOTAIO 

5,801 

26,646 

70.1 

21.2 


46.2 


20 

43 

196 

0..5 

0.2 

18.5 

34.4 


30 

5 

21 

0.1 

0.0 

19,7 

36,5 


40 

2,203 

10,119 

26,6 

8.0 

22,3 

41.5 


50 

77 

353 

0.9 

0.3 

20.8 

38.8 


60 

20 

92 

0.2 

0.1 

20.5 

38.2 


70 

51 

235 

0,6 

0.2 

20.9 

38,9 


80 

17 

80 

0.2 

0.1 

23.7 

44.0 


90 

55 

252 

0,7 

0.2 

24.7 

46.0 

STATE 


8,272 

37,994 


30.2 

24,0 

44,6 

REGION 


27,378 

125,748 



21.9 

40.6 
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TABLE 2 

INDICATORS OF YIELD RELIABILITY 
BASED ON D = PREDICTED - ACTUAL YIELD 

WILLIANS TYPE-MODEL - BARLEY 
NORTH DAKOTA AND MINNESOTA 

MSE, VAR, B-SQR (QUINTALS/HECTARE SQUARED) 
RMSE» SD, BIAS (QUTNTALS/HECTARE) 
RRMSE» RSD» RB (PERCENT OF AVERAGE YIELD) 


STATE CRD 

mse 

RMSE 

rrmse 

VAR 

SD 

RSD 

B-SOR BIAS 

RB 

N, DAKOTA 10 

8.73 

2.95 

15.2 

7.61 

2.76 

15.0 

1.12 -1,06 

-5.5 

20 

7.04 

2.65 

14.0 

6.84 

2.62 

14.2 

0.-20 -0.45 

-2.4 

30 

9.11 

3.02 

13.8 

7,78 

2.79 

13.4 

1.32 -1.15 

-5,2 

40 

9.32 

3.05 

15.7 

7.36 

2.71 

15,1 

1.96 -1.40 

-7.2 

50 

7.45 

2.73 

14.5 

5.81 

2.41 

13.8 

1.64 -1.28 

-6,8 

60 

19.46 

4.41 

19.0 

8.51 

2.92 

14.6 

10.96 -3.31 

-14.2 

70 

5.38 

2,32 

12,3 

5,04 

2,24 

12.3 

0,34 -0.58 

-3.1 

80 

7*12 

2,67 

16.7 

5*98 

2,44 

14,3 

1,14 1.07 

6.7 

90 

11.99 

3.46 

17.3 

3.29 

1.31 

10.6 

8,70 -2.95 

-14.7 

state model 

CRDS AGGR. 

10,92 

3.30 

15.7 

5.58 

2.36 

12.6 

5,34 -2.31 

-11.0 

7.83 

2.80 

13.3 

4,77 

2.18 

11.3 

3,06 -1,75 

-8.3 

minnesotaio 

17.71 

4.21 

16.9 

8,35 

2,89 

13,3 

9,36 -3.Q6 
0.76 -0.87 

-12.3 

40 

9.41 

3.07 

13.8 

8,66 

2.94 

13.7 

-3.9 

STATE MODEL 
CRDS AGGR. 

8.81 

2.97 

12.4 

5.20 

2.28 

10.3 

3,61 -1.90 

-7.9 

11.15 

3.34 

13.9 

5.48 

2,^34 

10.8 

5,66 -2.38 

-9.9 

REGION 



13.1 






CRDS AGGR. 

8.15 

2.85 

4.35 

2.09 

10.5 

3.80 -1.95 

-8.9 

STATES AGGR. 

9.42 

3.07 

14.0 

4.58 

2.14 

10.9 

4,84 -2,20 

-10,1 
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Figure 4. Itoot mean squEire error (PfiSE) for barley in quintals per hectare 
based on test year 1970-1979. Darker shades indicate CRDs with 
hitler production. 
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TABLE 3 

INDICATORS OF YIELD RELIABILITY 
BASED ON RD = 100 » ((PREDICTED-ACTUAL YItLD) /ACTUAL YIELD) 


WILLIAMS TYPE MODEL - BARLEY 
NORTH OAKATO AND MINNESOTA 


STATE CRD 

' PERCENT 
OF YEARS 
IROI >10% 

LARGEST IROI 

RD (YEAR) 

. 

NEXT 

LARGEST 

smallest 

IRDI 

RANGE 

IRDI 

N.DAKOTA 10 


-28.4 

(1973) 

26.8 

1.8 

26.6 

20 

50 

48.4 

(1974) 

-18.3 

-0.6 

47.8 

30 

50 

31.1 

( 1974) 

-22.5 

0.5 

30.6 

40 

60 

37.6 

(1974) 

-26,9 

-1.3 

36.4 

50 

60 

40.7 

(1974) 

-20,8 

-l.O 

39,7 

60 

80 

27.6 

(1976) 

-23.1 

0.0 

27,6 

70 

20 

=>24.9 

(1973) 

-17.9 

-1.0 

23.9 

80 

50 

38.6 

(1974) 

36.2 

-1.7 

36.9 

90 

80 

-38.5 

(1973) 

-18,8 

-2,3 

36.2 

STATE MODEL 

80 

-21.4 

(1977) 

-20.1 

2,8 

18.6 

CRDS AGGR, 

70 

19.2 

(1974) 

-19.1 

I.l 

18.1 

MINNESOTAIO 

60 

-27.7 

(1977) 

-26.2 

-1.6 

26.1 

40 

30 

33.1 

(1976) 

-24,2 

0.0 

33.1 

STATE MODEL 

50 

-24.8 

(1977) 

-13.0 

0.0 

24,8 

CRDS AGGR, 

50 

-26.9 

(1977) 

-14.6 

-1.3 

25.6 

REGION 

CRDS AGGR. 

70 

-17.9 

(1977) 

-17.7 

2.7 

15.2 

STATES AGGR. 

70 

-22,7 

(1977) 

-16.2 

2.7 

20.0 


Figure 5. Percent of test years (1970-1979) the absolute value of relative 
difference is greater than ten percent for beurley. Darker shcide: 
indicate CRDs with higher production. 







Figure 6. Largest absolute value of the relative difference for barley during 
the test years 1970-1979. Darker shades indicate CRDs with hi^^ier 
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TABLE 4 

INDICATORS OF YIELD RELIABILITY 
BASED ON ACTUAL AND PREDICTED YIELDS 

WILLIAMS TYPE MODEL - BARLEY 
NORTH DAKOTA AND MINNESOTA 


STATE CRD 

PERCENT C 
DIRECTION OF CH/ 
FROM PREVIOUS YEAR 

)F YEARS 
\NGE IS CORRECT 
FROM BASE PERIOD 

PEARSON 
COPR. COEF. 

N. DAKOTA 10 

67 

71 

0.55 

20 

67 

57 

0.47 

30 

67 

71 

0.51 

40 

78 

86 

0.69 

50 

67 

71 

0.73 

60 

56 

71 

0.63 

70 

44 

57 

0.52 

BO 

67 

71 

0.69 

90 

44 

100 

0.85 

STATE MODEL 

33 

57 

0.58 

CRDS AGGR. 

44 

n 

0.6S 

MINNESOTAIO 

89 

71 

0.54 

40 

89 

86 

0.80 

STATE MODEL 

44 

86 

0.63 

CRDS AGGR. 

67 

71 

0.62 

REGION MODEL 




CRDS AGGR. 

44 

71 

0.68 

STATES AGGR. 

67 

57 

0.64 
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Percent of the test years (1970-1979) the direction of change in 
predicted yield fran the previous year agrees with the direction 
of change in actual barley yield. Dar):er shades indicate CFDs 
with higher production. 
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Pferoent of test years (1970-1979) the direction of d^ge in predicted^ 
yield from the previous three year average agrees with the direction of 
change in act\ial barley yield. Darker shades indicate CFD's with higher 
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Pearscn cx>rrelation cxDefficient betwe>3n actial and predicted 
barley yields in the test years 1970-1979. Darker shades in- 
dicate 0®'s with hitler producticxi. 
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table 5 

, ^RESIDUAL MEAN SQUARE AS AN 
^INDICATOR OF THE FIT OF THE MODEL 
BASED ON THE MODEL DEVELOPMENT BASE PERIOD 

WILLIAMS TYPE MODEL - BARLEY 
NORTH DAKOTA AND MINNESOTA 


STATE 

1 

CRD 

base PERIOD 

residual mean square 

LOW HIGH AVERAGE 

INDEPENDENT 

TEST 

MSE 

N. DAKOTA 10 | 

3.20 

3.75 

3.51 

8.73 


20 

3.20 

3,75 

3.51 

7,04 


30 

3.45 

4.81 

3.84 

9.11 


40 

3,20 

3.75 

3,»51 

9.32 


50 

3.20 

3.75 

3.51 

7.45 


60 

3.45 

4.81 

3.84 

19.46 


70 

*» an 

-1 7C 

•a ^ c t 

r» ri 


80 

i 3.20 

3I75 

3.51 

3 • J 0 

7,12 


90 

' 3.20 

1 

3.75 

3.51 

11,99 

STATE 

MODEL 

1 1.25 

1 

2.21 

1.52 

10,92 

MINNESOTAIO 

3.45 

4.81 

3.84 

17,71 


40 1 
1 

j 3.45 

4.81 

3.84 

9.41 

STATE 

MODEL I 
1 

3.17 

3.85 

3.47 

8.81 
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CORRELATIOIT BETVIEEN OBSE^VEb^A^D PREDICTED YIELDS AS Ai^ 
INDICATOR OF THE FIT OF THE MODEL 
based on the model DEVELOPMENT BASE ^ErioO 

. . WILLIAMS TYPE MODEL - BARLEY 

NORTH DAKOTA AND MINNESOTA 


TEST 

STATE CRD 

1 BASE PERIOD 

1 CORRELATION COEF. 

1 LOW HIGH AVERAGE 

INDEPENDENT 
CORR. COEF. 

N. DAKOTA 10 

0.93 

0.94 

0.93 

0,55 

20 

0.93 

0.94 

0.93 

0.47 

30 

0.92 

0.94 

0.9? 

0.51 

40 

0.93 

0.94 

0,93 

0.69 

50 

0.93 

0.94 

0.93 

0.73 

60 

0.92 

0.94 

0.93 

0.63 

70 

0.93 

0.94 

0.93 

0,52 

SO 

0m'i3 

0.94 

0.93 

0 • 69 

90 

0.93 

0.94 

0.93 

0.85 

STATE MODEL 

0.97 

0.98 

0.97 

0,58 

MINNESOTAIO 

0.92 

0.94 

0.93 

0.54 

40 

0.92 

0.94 

0.93 

0,80 

STATE MODEL 

0.91 

1 

0.94 

0.93 

0.63 
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TABLE 7 

CURRENT INdiCATION OE 

modeled yield reliability 

agreement^between base period predicted 
and test ye:ar actual accuracy . . 

Jl , ‘flK .1. >* <• ' .. .. 


williams type model - BARLEY 

NORTH DAKOTA AND MINNESOTA 


STATE CRD 

spearman 

CORRELATION COEF. 

N. DAKOTA 10 

-0.09 

20 

0,09 

30 

-0.39 

AO 

-0.17 

50 

0.16 

60 

0,25 

70 

-0.73 

80 

0.08 

90 

-0,60 

STATE MODEL 

-0.20 

MINNESOTAiO 

0.30 

AO 

-0,60 

STATE MODEL 

-0,50 
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OF POOR QUAirrf 


APPENOIXl 

BOOTSTRAP TEST RESULTS 
FOR BARLEY YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A WILLIAMS TYPE MODEL 


STATE 

CRD 

yt'eld ■ 

YEAR ACTUAL 

( b / H ) ' 
PREO . 

D 

S . E . 

RD PRED , 

N. DAKOTA 

10 

1970 

20.1 

. 17.6 

- 2.5 

- 12.4 

2,02 



1971 

20.9 

20.0 

- 0.9 

- 4.3 

2.00 



1972 

21.0 

24.0 

3.0 

14.3 

2.08 



1973 

22.5 

16.1 

- 6,4 

- 28,4 

2.02 



1974 

13.8 

17,5 

3.7 

26.8 

2,12 



1975 

16.6 

16,9 

0,3 

1,8 

2.11 



1976 

19,0 

17.8 

- 1,2 

- 6.3 

2,15 



1977 

18 r 6 

16,2 

- 2.4 

- 12.9 

2.16 



1978 

25.0 

22.4 

- 2,6 

- 10.4 

2.08 



1979 

16.9 

15.3 

- 1.6 

“ 9 ? 5 

2.12 


20 

1970 

18.6 

17,4 

- 1.2 

- 6,5 

2,02 



1971 

21,4 

20,8 

— 0.6 

— 2.8 

2,00 



19 T 2 

20.6 

23.1 

2.5 

12.1 

2.03 



1973 

20,4 

18-1 

- 2.3 

- 11.3 

2,01 



1974 

12.2 

18.1 

5.9 

48.4 

2.15 



1975 

17.7 

16.6 

- 1.1 

- 6.2 

2.10 



1976 

19.8 

17.6 

- 2.2 

- 11.1 

2,16 



1977 

16,4 

16.3 

- 0.1 

- 0.6 

2.19 



1978 

22.5 

20.7 

- 1,8 

- 8.0 

2.07 



1979 

19.7 

16,1 

—3 • 6 

- 18.3 

2.12 


30 

1970 

19,5 

20.2 

0.7 

3.6 

2,39 



1971 

24.5 

23.6 

- 0.9 

- 3.7 

2.27 



1972 

21.9 

23.2 

1.3 

5.9 

2,15 



1973 

20.1 

20,2 

0.1 

0.5 

2.13 



1974 

14.8 

19.4 

4.6 

31.1 

2.16 



1975 

22.7 

17.6 

- 5.1 

-22. D 

2,09 



1976 

22.3 

18.2 

- 4.1 

- 18,4 

2,11 



1977 

21.8 

19.0 

- 2.8 

- 12.3 

2,24 



1978 

24.4 

22.8 

“ 1.6 

- 6.6 

2.33 



1979 

27.2 

23,5 

- 3.7 

- 13.6 

2.37 


40 

1970 

17,1 

17.9 

0,8 

4.7 

2.03 



1971 

21.5 

18.5 

- 3.0 

- 14.0 

1.99 



1972 

23.9 

23.6 

- 0.3 

- 1.3 

2.02 



1973 

20.8 

15.2 

- 5.6 

-26 • 9 

2,02 



1974 

11.7 

16.1 

4,4 

37,5 

2,14 



1975 

17.4 

17.1 

- 0.3 

- 1.7 

2.11 



1976 

19.9 

16.9 

- 3.0 

- 15.1 

2.10 



1977 

16.7 

16.4 

- 0.3 

- 1.8 

2.16 



1978 

25.5 

21.4 

- 4,1 

- 16.1 

2.10 



1979 

19.6 

17,0 

- 2.6 

— 1 3 * 3 

2.11 


'state 

N. DAKOTA 


original page 
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APPENDIX 1 

bootstrap TEST RESULTS 
. FOR BARLEY YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A williams TYPE MODEL 


CRD 


year' 

TI£LD 

ACTUAL 

. (Q/H) . 
PRED. 

d" 

■ RO ■ 

S.E., 

PRED. 

1970 

17,7 

16.3 

-1.4 

-7,9 

2.01 

1971 

24,5 

20,5 

-4.0 

-16.3 

1.99 

1972 

20.4 

20.2 

-0.2 

-1.0 

2.00 

1973 

14.5 

12.9 

-1.6 

-11.0 

2,05 

1974 

12.3 

17.3 

5.0 

40.7 

2,19 

1975 

19.9 

17.3 

-2.6 

-13.1 

2.10 

1976 

18.3 

14.5 

-3.8 

-20.3 

2.09 

1977 

16.7 

16.4 

-0.3 

-1.8 

2,20 

1978 

22,9 

21.1 

-1.8 

-7.9 

2.09 

1979 

20.9 

18.8 

-2.1 

-10.0 

2,12 

1970 

17.5 

19.7 

2.2 

12,6 

2,42 

1971 

26.5 

22.4 

-4.1 

-15.5 

2.23 

1 Q7? 

22,6 

22.4 

=0.2 

= 0.9 

O 1 /. 

1973 

21.3 

18.4 

-2.9 

-13,6 

2.17 

1974 


18.4 

0.0 

0.0 

2.20 

1 975 

21.5 

18.0 

-3.5 

-16.3 

2.09 

1976 

22.8 

16.5 

-6.3 

-27,6 

2.12 

1977 

24.1 

18.8 

-5.3 

-22.0 

2.22 

1978 

28.6 

22.0 

-6 . 6 

-23.1 

2.34 

1979 

29.3 

22.9 

-6.4 

-21.8 

2.37 

1970 

16.4 

17.9 

1.5 

9.1 

2.02 

i 9 M 

21.6 

20.3 

-1,3 

-6.0 

1.99 

19 f '2 

21.4 

23.3 

1.9 

8.9 

2.06 

1973 

22.1 

16.6 

-5«5 

-24,9 

2.02 

1974 

15.3 

16.7 

1 .4 

9.2 

2,1 1 

1975 

16.9 

17.4 

0.5 

3,0 

2.13 

1976 

19.6 

16.1 

-3.5 

-17.9 

2.09 

1977 

17.2 

17.7 

0.5 

2.9 

2.1 1 

1978 

20.8 

20.6 

-0.2 

-1.0 

2.14 

1979 

17.7 

16.6 

-1.1 

-6,2 

2.11 

1970 

13.0 

15.7 

2.7 

20.8 

2.02 

1971 

21.4 

20.0 

-1.4 

-6.5 

1,99 

1972 

18.9 

22.0 

3.1 

16.4 

1,97 

1973 

16.3 

12,5 

-3.8 

-23.3 

2.02 

1974 

10.1 

14.0 

3.9 

38.6 

2,19 

1975 

17.8 

17.5 

-0.3 

-1,7 

2.1 1 

1976 

14.2 

14.5 

0.3 

2.1 

2,08 

1977 

12.7 

17.3 

4.6 

36,2 

2.14 

1978 

19.0 

20.0 

1.0 

5.3 

2,18 

1979 

16.5 

17,1 

0.6 

3,6 

2.11 


50 


60 


70 


80 
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APPENDIX 1 

BOOTSTRAP TEST RESULTS 
FOR BARLEY YIELDS IN 
NORTH DAKOTA AMO MINNESOTA 
USING A WILLIAMS TYPE MODEL 

YIELD (O/H) 

YEAR ACTUAL PREO. D 

RD 

S.E. 

PRED. 

N. DAKOTA 90 

1970 

18.5 

15.9 

-2.6 

-14,1 

2.03 



1971 

24.8 

20.8 

-4.0 

-16.1 

1.98 



1972 

21.3 

20.8 

-0.5 

-2.3 

2.03 



1973 

18,7 

11.5 

-7,2 

-38.5 

2,02 



1974 

17.1 

16.5 

-0.6 

-3.5 

2.23 



1975 

17.8 

15.5 

-2.3 

-12,9 

2.18 



1976 

13.8 

11.2 

—2 . 6 

-18.8 

2,07 



1977 

23.1 

19.5 

-3.6 

-15.6 

2.15 



1978 

22.3 

20.0 

— 2 a 3 

-10.3 

2.17 



1979 

22,9 

19.1 

-3,8 

-16.6 

2.10 

STATE 

MODEL 

1970 

18.3 

19.0 

0.7 

3.8 

1,95 



1971 

24.2 

21,5 

-2.7 

-11.2 

1.77 



1972 

21.5 

22.1 

0.6 

2.8 

1.77 



1973 

19.9 

17.1 

-2.8 

-14.1 

1.69 



1974 

15.1 

1 r.2 

2.1 

13.9 

1.97 



1975 

20.4 

16.3 

-4.1 

t20,1 

1.65 



1976 

20.4 

16.8 

—3 . 6 

-17.6 

1.74 



1977 

21.0 

16.5 

-4.5 

-21.4 

1.72 



1978 

24.7 

20,4 

-4.3 

-17,4 

1.84 



1979 

24.7 

20.2 

—4 • 5 

-18.2 

1.95 

CRDS 

AGGR, 

1970 

18.3 

18.5 

0,2 

1.1 




1971 

24,2 

21.9 

-2.3 

-9.5 




1972 

21.5 

22.5 

1,0 

4.7 




1973 

19.9 

17,1 

-2.8 

-14.1 




1974 

15.1 

18.0 

2,9 

19.2 




1975 

20.4 

17.3 

-3.1 

-15.2 




1976 

20.4 

16.5 

-3.9 

-19.1 




1977 

21.0 

18.3 

-2.7 

-12.9 




1978 

24.7 

21.8 

-2 . 9 

-11.7 




1979 

24.7 

20,8 

-3.9 

-15.8 



/ 



u' 

I'-A 
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40 


STATE MODEL 


CRDS AGGR. 


APPENDIX 1 

BOOTSTRAP TEST RESULTS 
FOR barley YIELDS IN 
NORTH DAKOTA AND MINNESOTA 
USING A WILLIAMS TYPE MODEL 


YEAR 

YIELD 

ACTUAL 

(Q/H) 

PRED, 

D 

RO 

S.E. 

PRED. 

1970 

18,4 

20,8 

2.4 

13.0 

2.41 

1971 

26,9 

24,1 

-2.8 

-10,4 

2.28 

1972 

24.8 

24.4 

-0.4 

-1.6 

2.15 

1973 

24,2 

22.2 

-2.0 

-6.3 

2.13 

1974 

20,9 

19.2 

-1.7 

-8.1 

2.20 

1 975 

21,5 

19.6 

-1.9 

-8 . B 

2,10 

1976 

26,7 

19.7 

-7.0 

-26.2 

2,11. 

1977 

27,4 

19.8 

-7,6 

-27,7 

2.24 

1978 

28,4 

23.7 

-4,7 

-16,5 

2.36 

1979 

29,4 

24,5 

•a4 . 9 

-16.7 

2.33 

1970 

22,9 

22.2 

-0.7 

-3. 1 

2.36 

1971 

25,2 

23.0 

-2.2 

-8,7 

2.25 

1972 

19,3 

19.4 

0,1 

0.5 

2.39 

1973 

CO , J 

22.2 

-4.1 

-15.6 

2. IS 

1974 

21,2 

21.9 

0.7 

3,3 

2,16 

1975 

18.6 

20.4 

1.8 

9.7 

2.10 

1976 

13,3 

17.7 

4,4 

33,1 

2.13 

1977 

27.7 

21.0 

-6,7 

-24,2 

2.24 

1978 

22.2 

22.2 

0.0 

0,0 

2.40 

1979 

26.4 

24,4 

-2.0 

-7.6 

2.38 

1970 

19,9 

19.9 

0.0 

0.0 

3.47 

1971 

26.1 

22,8 

-3.3 

-12.6 

2.92 

1972 

23.1 

24,0 

0.9 

3.9 

2.78 

1973 

24.7 

23.8 

-0.9 

-3,6 

2.70 

1974 

21.0 

20.4 

-0,6 

-2.9 

2,74 

1975 

20.4 

21.2 

0.8 

3.9 

2.47 

1976 

22.1 

19,6 

-2.5 

-11.3 

2.37 

1977 

27.4 

20.6 

-6,8 

-24.8 

2.31 

1978 

26.6 

23.7 

-2.9 

-10,9 

2.58 

1979 

28.5 

24.8 

-3.7 

-13.0 

2.50 

1970 

19.9 

21.3 

1,4 

7,0 


1971 

26,3 

23.7 

-2,6 

-9.9 


1972 

23,3 

23.0 

-0.3 

-1.3 


1973 

24.8 

22.2 

-2,6 

-10,5 


1974 

21,0 

20.2 

-0.8 

-3.8 


1975 

20,5 

19.9 

-0.6 

-2,9 


1976 

22.2 

19.0 

-3.2 

-14,4 


1977 

27.5 

20.1 

-7.4 

-26,9 


1978 

26.8 

23.3 

-3.5 

-13.1 


1979 

28.7 

24.5 

-4,2 

-14,6 
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APPENDIX 1 

BOOTSTRAP TEST RESULTS 
FOR barley yields IN 
NORTH DAKOTA AND MINNESOTA 
USING A WILLIAMS TYPE MODEL 


YEAR' 

..YIELD. 

Actual 

(Q/H) 

PRED. 

D 

RO 

1970 

18,6 

19,1 

0.5 

2.7 

1971 

24.8 

22.4 

-2.4 

-9.7 

1972 

21 .9 

22.6 

0.7 

3.2 

1973 

21.1 

18.3 

-2.8 

-13.3 

1974 

16.6 

18.6 

2.0 

12.0 

1975 

20.5 

18.0 

-2.5 

-12.2 

1976 

20.9 

17.2 

-3.7 

-17,7 

1977 

22.9 

18.8 

-4.1 

-17.9 

1978 

25.4 

22.3 

-3.1 

-12.2 

1979 

26.0 

21.9 

-4.1 

-15.8 

1970 

18.7 

19.2 

0,5 

2.7 

1971 

24.7 

21.9 

-2,8 

-11.3 

1972 

21.9 

22.5 

0.6 

2,7 

1973 

21.1 

18.7 

-2.4 

-11.4 

1974 

16.7 

18.1 

1.4 

8,4 

1975 

20.4 

17.7 

-2.7 

-13.2 

1976 

20.9 

17.6 

-3.3 

-15.8 

1977 

22.9 

17.7 

-5,2 

-22.7 

1978 

25.3 

21 .4 

-3.9 

-15.4 

1979 

25.9 

21.7 

-4.2 

-16.2 


S.E. 

PRED. 


AGGR. 


AGGR, 


- Terns and fengss ODefflcLent WLles Over T&i Years 


' 4 . 
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